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TECHNIQUE FOR DEFINING PROBABILISTIC 
RELIABILITY TEST REQUIREMENTS 

Field Of The Invention 

The present invention relates to the field of electronic equipment reliability 
testing. More specifically, it relates to a method for systematically translating field 
temperature conditions associated with particular packages/products into accelerated 
life testing requirements based on a pre-determined set of design use inputs, 
consumer behavior patterns, and environmental field conditions. 

Background Information 

Central Processing Unit (CPU) and certain non-CPU electronic chips are 
generally embedded in a package unit that provides several design advantages. 
Package units facilitate attachment to a computer motherboard and enhance thermal 
dissipation from the chip. The package units also provide a convenient structural 
interface for transmitting power to the chip and routing input/output (I/O) signals. Over 
time, temperature fluctuations, caused by typical events that occur either in the 
external environment of the relevant product or internally within the chip, can cause 
the package units to fail. One common cause of such failures is solder-ball fatigue, in 
which the solder balls that connect package units to the motherboard collapse due to 
cyclical stress fatigue driven from temperature fluctuations. These temperature 
fluctuations can also stress interfaces between the chip and the packaging unit as a 
result of differing thermal expansion coefficients for materials across the interfaces. 
The stresses may reach a level where the package or chip fails due to fretting, 
warping, bowing or cracking. Such failures that occur over the operational lifetime of 
the relevant product are a problem for silicon chip manufacturers that generally 
guarantee the operability of the chip/package unit over a warranty lifetime, typically 
seven to ten years. 
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Therefore, to ensure the reliability of chip and package products, tests are 
conducted under conditions that simulate the effects of the temperature fluctuations 
that are likely to occur over the warranty lifetime of the products. Since it is 
5 impractical to perform simulations over long periods of time, i.e., over the actual 
length of the warranty period, reliability tests are conducted under accelerated 
conditions. Acceleration may occur by exposing the package unit to temperature 
conditions that are more extreme than normal field conditions (such as in 
Temperature Cycling) or may result from maintaining typical temperature fluctuations 
10 and compressing the time scale for how frequently events occur (such as in Power 
m Cycling). 

IS However, accelerated reliability test requirements cannot be accurately defined 

2J without a well-defined set of environmental use conditions pertaining to a specific 
SR product and an algorithm to quantify the expected frequency and magnitude of 
r J 15 temperature fluctuations across the chip and the package unit. To compensate for 

this uncertainty and lack of accuracy, accelerated reliability test requirements are 
p generally over-estimated (guard banded). In other cases, requirements are related to 
^ a baseline such as a military standard, which has been prescribed for unrelated 
^ products. Thus, by failing to consider the appropriate environmental conditions and 

20 application use factors, designs may be forced to meet requirements that are not 
necessary for their use conditions (e.g. extreme cold from outer space). 

Brief Description Of The Drawings 

Figure 1 is a functional block diagram depicting the algorithms used to systematically 
25 translate the field operating temperature conditions associated with a package/chip to 
the accelerated life testing conditions according to the present invention. 

Figure 2 illustrates a representative program interface used for inputting user-defined 
criterion according to the present invention. 
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Figure 3 illustrates schematic graphs of an exemplary power and temperature 
fluctuation profile for a package/chip device over time. 



Figure 4 shows a modified Coffin-Manson empirical model, which calculates the 
5 number of accelerated test cycles required to account for temperature fluctuations in 
each of the temperature fluctuation regimes. 

Figure 5 displays exemplary input and output data from a calculated temperature 
profile and accelerated life model for a mobile (laptop) computer that incorporates a 
io package/chip device. 

Figure 6 illustrates the effect package location has on mean temperature and 
temperature fluctuations within electronic devices subject to power cycle fluctuations. 

15 Detailed Description 

In accordance with the present invention, a statistically rigorous method ties 
consumer behavior, package/chip use environment, environmental weather 
information, material property behavior, and accelerated life-testing models together. 
Afunctional block diagram of the present invention is shown in Figure 1, which 

20 indicates various inputs and/or subroutines, which may be executed on a general- 
purpose computer or electronic device having attached memory. User-defined 
criterion ("user inputs") related to package unit design and use, such as the product 
use market, the accelerated test chamber environment, the product shipping route, 
power consumption, and the desired product warranty life are represented by block 

25 10. A user enters these parameters via a program interface, described in greater 
detail below. The input information is then supplied to subroutines represented by 
blocks that incorporate consumer behavior 14, application workload information 16 
and probable environmental conditions 18, respectively. 

30 Consumer behavior 14, application workload 16, and environmental condition 

18 subroutines apply information obtained from attached databases to the information 
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provided in the user inputs 1 0 to compute estimates of specific parameters related to 
use conditions of the package/chip such as, for example, the amount of time a 
particular package/chip-bearing-product is on, the power consumption of the chip, and 
whether or not the product is generally in a air-conditioned environment. Consumer 
behavior subroutine 14 applies data compiled from such internal market research and 
customer surveys that define the likelihood of occurrence for different temperature 
events. The application workload subroutine 16 applies data from benchmark and 
field tests that span numerous applications and operating system combinations. 
Information gathered from these studies includes power consumption associated with 
a given operational state (e.g., application use, idle, off/sleep). Environmental 
conditions subroutine 18 derives ambient temperature conditions for the particular 
product type specified in the user input. The data corresponds to ambient 
temperatures inside a computer system derived from a function based on atmospheric 
data and field-tests of different chassis/box combinations. 

The combination of user input information 10 and the parameters derived from 
customer behavior subroutine 14 are supplied to a temperature frequency calculation 
subroutine represented by block 20. This subroutine derives an estimate of the 
number of temperature fluctuations that the product undergoes over its lifetime. In 
particular, the temperature frequency block 20 estimates the number of occurrences 
in each of several temperature regimes: shipping (air and ground), storage, power 
on/off, power on to idle, shifts between application use, and shifts within application 
use, and in some cases temperature changes due to transport by the end user. 

The output temperature frequency parameters calculated by the temperature 
frequency block 20 and the parameters calculated by the application workload 16 and 
environmental conditions 18 blocks are input to a temperature profile subroutine 
represented by block 25 which calculates a probability density function for each 
temperature regime. The distribution of temperatures occurring during the 
temperature fluctuations, the transition periods during and between fluctuations, ramp 
times and the amount of time the products dwell at a particular elevated or reduced 



temperature are also estimated. The temperature profile data output from the 
temperature profile block is entered directly into a Monte Carlo simulation subroutine 
to derive a probability density function for estimating the product's temperature over 
time. This output is shown as a graph in block 28. The graph illustrates multiple 
5 sources of temperature fluctuation through the life of the product from shipping to 
storage to operational use. 

In addition, user inputs 10, and single point estimates of the parameters 
derived from the temperature frequency block 20 and the temperature profile block 

10 25, are input to an accelerated life model, represented by block 30. The accelerated 
life model 30 includes equations known in the art such as the Coffin-Manson model, 
which iteratively derives point estimates of the number of accelerated test cycles 
required to approximate the temperature profile of the product given the provided user 
inputs. The point estimates are stored as part of a probability density function. The 

15 calculations of the accelerated life model 30 are presented as a graph 35 depicting 
the percentage of package units that are exposed to the number of accelerated life 
cycles that have been performed. 

Figure 2 depicts the program interface 50 used to provide the user inputs 10 to 
20 the various subroutines. The program interface 50 may be implemented using any 
means such as a Visual Basic dialog box, for example. It is noted that the actual 
design and format of the interface 50 is merely exemplary and that other formats 
and/or configurations may equally be used. At the top of the program interface is a 
"Number of Trials to Run" entry box 52, that allows a user to preset the number of 
25 Monte Carlo simulations selected for the evaluation. In general, a larger number of 
simulations (trials) yield higher accuracy associated with the resulting probability 
density function. The value selected for the number of trials is only restricted to a 
positive integer. Requirements needed for numerical converge range from as low as 
500 to well over 1,000,000 depending on the complexity of the underlying equations. 
30 Below the "Number of Trials to Run" box 52, is a "Max Temp at failure location" entry 
box 54 that enables the user to specify the maximum temperature likely to occur (in 
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degrees Celsius) at the location of the failure mode (described below) for the 
particular package/chip combination. The maximum temperature value is used as an 
upper temperature bound and allows the expected temperature distribution during 
package/chip operation to be scaled appropriately. 

5 

Directly below entry boxes 52 and 54, there is a bordered Delta-T stress 
chamber box 60 including entry boxes 62, 64, 66 via which the parameters describing 
the accelerated test chamber environment are entered. A Temp Cycle drop down box 
62 provides for adjustment of the type of temperature cycle condition within the test 
^ 10 chamber, a mean temperature entry box 64 provides for adjustment of the nominal 
*0 temperature fluctuation (delta) within the chamber (also in degrees Celsius) and a 
f5 standard deviation box 66 provides for adjustment of the variation about the nominal 
value assuming a normal distribution of temperature values. The mean temperature 
IP delta and standard deviation define the range of values that are input into the 

1 is accelerated life model 30. 



The manner in which an electronic device converts applied electrical power into 
heat is a particularly significant criterion influencing the package/chip toward a 
particular failure mode. To account for this criterion, the program interface includes 

20 entry boxes for Thermal Design Power (in watts) 70. In addition to basic design 
specifications such as power consumption, microprocessor architecture is also 
influential factor. As transistor gate lengths continue to shrink, leakage current is 
becoming more significant. The Leakage Power 72 estimates the heat generated 
from this current flow. Further entry items include the Failure Mechanism box 74 that 

25 allows the user to select from a predetermined set of failure types such as solder ball 
fatigue, fretting, cracking, and package/chip interface deformation. The failure 
mechanism selected is dynamically linked to a value for the power law coefficient 
shown in box 76. The power law coefficients are values used as the exponents in the 
Coffin-Manson empirical model used in the Accelerated Life Model (described in 

30 greater detail below). The magnitude of the coefficient depends upon the selected 
failure mode. For instance, historical studies of the power law coefficient for the 
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solder ball fatigue failure mechanism range from approximately 1 .9 to 2.1. The Power 
Law Coefficient input box 76 allows the user to make adjustments to the preset 
coefficients determined according to the selected failure mode. Such adjustments 
may be necessary to account for modifications to the chip/package design, for 
5 example. 

The program interface 50 also allows the user to select the market segment, 
the shipping path, and the warranty lifetime. Using the Market Segment box 80, the 
user can choose between CPU and non-CPU market types, such as Desktop, Laptop, 
Server, Workstation, Telecommunications, Handheld devices, Personal Digital 
Assistants (PDA) and cellular, among others. The market segment determines the 
product environment of the package/chip and the consumer use patterns associated 
with the product. For example, since laptops typically contain a smaller fan, they are 
subject to higher temperatures than desktops for equal application use. Furthermore, 
servers are generally kept on constantly except during maintenance and therefore do 
not undergo as many on/off cycles as the other product types. These differences 
have a direct effect upon the number and magnitude of the AT fluctuations. 

Through the Shipping Path entry box 82, the user selects the shipping route 
20 that determines the environment that the package/chip will experience en route from 
the chip manufacturer to a product assembly site to a reseller. These shipping routes 
offer options ranging from typical flows through a distributor channel to more 
specialized extended flow routes. Based on tabulated field data, the expected 
number of freeze/thaw cycles is dynamically linked to each of these shipping routes, 
25 and thereby impacts the temperature profile requirements of the package/chip. The 
Field Life Requirement (shown in Figure 2 as Duration (years)) box 84 allows the user 
to specify the length of time that the package/chip is to be evaluated. Generally, the 
length of time is chosen as the warranty life of the package/chip, which may be one to 
ten years, for example. 
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All of the parameters chosen by the user via the program interface 50 are used 
to model the temperature profile of the package/chip during its lifetime. Figure 3 
schematically illustrates the temperature and power use of an exemplary 
package/chip used in a particular market segment over time in respective graphs 90 
5 and 1 00. As can be discerned, the temperature of the package/chip fluctuates widely 
overtime. The range of the temperature fluctuations (denoted as AT) depends on the 
use conditions of the package/chip device. At the beginning of the device lifetime the 
chip is not running (is off) as shown in portion 92 of the power graph 90, and it is in a 
storage condition. While in storage, the device experiences ambient temperature 
10 fluctuations in accordance with the environmental conditions of the storage locations. 
Cj The typical temperature fluctuations during storage, denoted AT s torage, are shown at 

. irk 

m 102 on the temperature graph 100. At this stage, the number of cycle corresponding 

^ to a temperature fluctuation cycles of breadth AT st0 rage is estimated for the lifetime of 
P the device. This quantity is computed using the customer data subroutine as 
g 15 indicated above. 

¥* After the device is in storage as depicted in temperature graph 100, it is 

q shipped to the Original Equipment Manufacturer (OEM) and eventually the retailer 
N and is subject to temperature fluctuations during the shipping process of magnitude 

20 ATshipping 104. The ATshipping fluctuations can be subdivided into ground and air 

shipping cycles, each having its own particular ambient temperature conditions. The 
approximated number of ground and air shipping cycles for ATshipping is also 
determined through field studies and the Environmental Conditions algorithm 18. It is 
noted in this context that the temperature graph is merely an exemplary and 
25 schematic representation of the actual sequence of temperature fluctuations. For 
instance, the storage and shipping events may occur in different combinations and 
sequences. 

After the shipping cycles end as shown in the power and temperature graphs 
30 90 and 100, the device is installed and put into operation. When the device is turned 
on, power use increases from zero in the off state 92 to a power level associated with 
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typical application use 94. As the chip consumes power, the temperature of the 
package/chip device rapidly increases from a baseline in the off state to a local 
maximum. For high power electronic devices, the rate of temperature change during 
these power cycles is distinctly different from the rates of temperature change during 
5 other fluctuation cycles (e.g., storage and shipping) that occur due to changes in the 
ambient temperature in the environment of the package/chip device. The rapid 
conversion of electrical power to heat in this process also causes thermal gradients to 
form in across the components of the package/chip device. As a result of these 
gradients, environmental test methods for warranty reliability testing must be 
p 10 conducted differently. The on/off power cycle fluctuation at the chip die is shown as 
J AT 0 n/off 106. Once a steady state temperature is reached, temperature fluctuations still 
if! occur that are driven by changes in power within and between software use. The 

0 resulting fluctuations are characterized by a maximum fluctuation amplitude AT app 110. 

m 
y* 

j\ is After the chip runs an application for some time, it may enter an idle state in 

O which a much smaller amount of power is consumed but no application is running. In 
m the idle state the chip performs no operations and thus consumes less power, causing 
^ the temperature of the device to decrease to an idle-state baseline determined by the 

design characteristics of the chip (e.g. Leakage Power). The temperature fluctuations 
20 between operational and idle states have a typical magnitude AT on /id!e 1 08. In 

addition, as different applications are used or executed, the power use fluctuates (as 

shown at 96). 

The temperature fluctuations AT on / 0 ff and AT on /idie are derived from the user 
25 inputs about primarily chip design characteristics and to a lesser extent the market 
segment and the consumer behavior subroutines. The application use fluctuations 
ATapp are calculated with the additional aid of the application use subroutine that 
stores information concerning the power consumed by various applications. The 
number of such events is calculated using user inputs and the relevant consumer 
30 behavior and application use subroutines. If the market segment selected in the user 
inputs is a mobile segment such as Laptops, the package/chip device is also exposed 
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to further ambient temperature fluctuation cycles caused by movement of the mobile 
device between locations. These fluctuations are denoted by AT use rxfer 1 12. 

Each of the temperature fluctuations AT, pertaining to any of the ambient 
temperature cycles or power cycles discussed above is not modeled as a constant, 
but rather can be mathematically modeled as a distribution with corresponding 
parameters (e.g. mean and standard deviation in the case of a normal distribution). In 
addition, location affects are accounted for in the application workload 16 algorithm. 
For example, failure modes that occur farther from the die such as the capacitors, 
interposers, socket and heat sink, will have smaller temperature drops to ambient 
temperatures and will vary less, as depicted by narrower temperature distributions as 
shown schematically in Figure 6. 

When the magnitude and frequency of the temperature fluctuation (non-on/off 
power cycle) events have been fully accounted for and estimated, these values are 
input into an accelerated life model such as the Modified Coffin-Manson empirical 
model depicted in Figure 4. According to this modified model, the total number of 
accelerated reliability cycles required to accurately model the temperature profile of 
the package/chip device is equivalent to a sum of: 

1) the number of accelerated test cycles required to separately model 
temperature fluctuations due to storage cycles; 

2) the number of accelerated test cycles required to separately model 
temperature fluctuations due to shipping cycles, both ground and air; 

3) the number of accelerated test cycles required to separately model power 
cycle fluctuations including on/idle, application use, and, if the market segment 
is of a mobile type, cycles due to movement of the product between various 
locations and/or environments. 

Equation 205 in Figure 4 shows this equation, with summation terms 206, 207 
and 208. In turn, each of the terms 206, 207, 208 is related to the estimated number 
of storage, shipping and operation cycles occurring over the device lifetime (shown in 
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Figure 3) according to the equivalence arrows shown in Figure 4. As indicated in 
Figure 4, the number of accelerated test cycles required to model a type of fluctuation 
event is equivalent to the estimated number of actual fluctuation cycles that will take 
place in the device's lifetime multiplied by temperature fluctuation ratios raised to the 
5 power coefficient (n) specified through the program interface (related to the failure 
mode). These multiplication-product terms are referred to as usage cycle terms 210, 
211,212,213,214,215. 

Each of the temperature fluctuation ratios of the usage cycle terms are equal to 
an expected temperature change for the particular use divided by the temperature 
fluctuations within the acceleration chamber multiplied by a offset multiplier, a. The a 
term accounts for differences in creep and plasticity effects resulting under use 
condition temperatures as compared to those incurred under the accelerated test 
conditions. 

The a term is uniquely defined for each temperature fluctuation regime, since 
the mean temperature varies between use types (regimes). Therefore, through AT use 
and a, each of the six usage cycle terms 210, 21 1, 212, 213, 214, 215 (storage, 
shipping air, shipping ground, application use, on/idle, and operating transport) has a 
corresponding temperature fluctuation ratio. 

Since the AT values for each of the different fluctuation types are defined by 
probability density functions rather than exact values, each of the usage cycle terms 
(being functions of the AT values) range in values according to a corresponding 
25 probability density function. Moreover, since the total number of acceleration cycles 
Nacceijotai is equal to the summation of the six usage terms, it also is described by a 
probability density function. These estimated number of acceleration test cycles, 
Nacceijotai, needed to test the reliability of the package/chip vary over a range of values 
from a minimum of Ni cycles to a maximum of approximately N 2 cycles. As a 
30 consequence, if fewer than Ni cycles are performed, the acceleration test provides a 
0% certainty level, while if greater than N 2 cycles are performed, the certainty level 
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approaches 100% of the population. Accordingly, the area in between fsh and N 2 
corresponds to the certainty level of the accelerated test. This certainty level ranges 
between 0 and 100 percent and allows the user to specify a specific numbers of 
acceleration cycles corresponding to a certainty level of interest. 

Figure 5 displays exemplary input and output data from a calculated 
temperature profile and accelerated life model for a Mobile computer that incorporates 
a package/chip device. The output includes a graph of the probability density function 
of N acC ei jotai 300 and a tabulation of calculated parameters including estimates of the 
number of and magnitude of temperature fluctuations in each of the six temperature 
regimes. As can be discerned, the circles and arrows in the tables indicate how listed 
parameters are used in the usage terms 310 of the modified Coffin-Manson model 
equation shown at the bottom of the figure. In Figure 5, there are three tables of 
values as shown: the first table 320 lists the user inputs entered via the program 
interface; a second table 330 summarizes the Temperature Cycle test requirements, 
and a third table 340 summarizes the Power Cycle test requirements. Table 330 
contains several summary statistics for each temperature fluctuation regime 331 
which includes the approximated number of fluctuation cycles 332, the creep and 
plasticity adjustment term 333, the minimum 334 and maximum 335 temperatures, the 
mean temperature fluctuation 336, the standard deviation of the temperature 
fluctuation 337, the number of equivalent acceleration test cycles corresponding to the 
60%, 90%, and 99% certainty levels 338, and finally the damage (expressed as a 
percentage of total damage) associated with a particular regime of the package/chip 
339. Similarly, Table 340 provides the summary statistics for the number of cycles 
341 , minimum 342 and maximum 343 temperatures, the mean temperature 
fluctuation 344, and its corresponding standard deviation 345. It is again noted that 
the format and values of the tabulated results shown in Figure 5 are merely 
exemplary. 

As shown in Figure 5, two of the factors in the user input area 320, the mean 
temperature fluctuation in the testing chamber, and the power law coefficient, are 
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circled. An arrow points from mean temperature fluctuation value (equal to 190°C in 
the example shown) to each of the AT acC e! values in the usage terms 310, and another 
arrow points from the power law coefficient value (equal to 2.0 in the example shown) 
to the exponent (n) in the shipping usage term (although all usage terms have the 
same exponent (n)). Similarly, each of the approximated number of fluctuation cycles 
332 and the mean temperature fluctuation 336 and 337 for each of the six 
temperature fluctuation regimes 331 are circled and have arrows pointing to where 
each of these values are used in the usage term corresponding to the temperature 
regime. In this way, Figure 5 clearly indicates the derivation of the N aC ceijotai 
probability density function shown in graph 300. 

The results of the probability density function are summarized in section 338 
for the 60%, 90%, and 99% levels. These values are merely exemplary as any level 
of certainty may be specified. The certainty levels can be interpreted as the 
percentage of package/chip devices that experience at least that level of stress over 
its warranty life. The precision of these estimates is a function of the number of 
Monte Carlo simulation trials. As described above, the greater the number of 
accelerated test cycles that the device is exposed to without failure, the greater the 
level of certainty that the device will be able to withstand temperature fluctuations in 
the field. For this reason, the 99% certainty level corresponds to 570 cycles, which is 
greater than the number of cycles for the 90% (450 cycles), and the 60% levels (330 
cycles). The 60%, 90% and 99% certainty levels are shown by respective dash 
marks 302, 304 and 306. 

The output shown in Figure 5 provides an approximation of the expected value 
(mean) and variability (standard deviation) of the various temperature cycles. As a 
result of the uncertainty or lack of precision associated with previous methods known 
in the art, the range (standard deviation) of AT estimates are often several multiples 
greater than those calculated in the output. This suggests that current methods carry 
inflated estimates of variability that are far too conservative and can be reduced 
significantly. It is therefore clear that quantifying the contributions of each of the 
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temperature regimes separately dramatically affects the guard bands used in the 
accelerated life model. 



In the foregoing description, the method of the invention has been described 
5 with reference to a number of examples that are not to be considered limiting. Rather, 
it is to be understood and expected that variations in the principles of the method 
herein disclosed may be made by one skilled in the art, and it is intended that such 
modifications, changes, and/or substitutions are to be included within the scope of the 
present invention as set forth in the appended claims. In addition, the principles of the 
10 method of the invention may be applied to alternate Accelerated Life Models such as 
an Arrhenius relationship for sustained high temperature exposure. In addition, this 
approach may be applicable to areas outside package/chip reliability testing. For 
example, the foregoing method may also be applicable to silicon-based defect 
modeling. 

15 

Furthermore, while the mechanisms described can be embodied in hardware 
within a computer processor, the invention is not necessarily limited thereby, and the 
programmed logic that implements the mechanisms can be separately embodied and 
stored on a storage medium, such as read-only-memory (ROM) readable by a general 
20 or special purpose programmable computer, for configuring the computer when the 
storage medium is read by the computer to perform the functions described above. 
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